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from  the  application  of  standard  asymptotic  analysis  to  this  detection 
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CHAPTER  1 
INTRODUCTION 

The  field  of  sequential  detection  theory  was  established  in  the 
mid  1940's.  The  early  development  of  this  field  was  based  on  the  work 
of  researchers  motivated  by  wartime  needs,  such  as  radar  systems. 

In  more  recent  years,  research  on  sequential  detection  theory  has 
been  concerned  with  truncation  effects,  rank  test  (P.  K.  Sen  and  M.  Ghosh 
1974,  and  M.  R.  Reynolds,  Jr.  1975),  and  mathematical  modeling.  In  the 
large  majority  of  work  in  this  area  the  assumption  of  independent, 
identically  distributed  (i.i.d.)  observation  is  used.  In  this  thesis  we 
will  concentrate  on  designing  optimum  sequential  detection  procedures 
for  a  non-i.i.d.  observation  model,  while  retaining  the  recursive  nature 
of  tests  designed  for  i.i.d.  models.  Because  the  sample  size  is  not 
fixed  and.  the  samples  are  not  i.i.d.,  large  memory  lengths  are  often 
required  by  the  detector.  Our  recursive  detector  only  requires  finite 
memory  length  so  that  it  is  particularly  well  suited  for  this  purpose. 

In  Chapter  2,  we  derive  a  necessary  condition  for  the  optimum 
recursive  detector  structure  in  terms  of  an  integral  equation  for  a 
nonlinearity  characterizing  this  optimum.  A  paradox  arises  in  this 
development  and  is  examined  in  Chapter  3.  Finally  a  numerical 
solution  of  the  integral  equation  is  given  in  Chapter  4. 
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1.1  The  Sequential  Probability  Ratio  Test 

Sequential  analysis  is  a  method  of  statistical  inference  whose 
characteristic  feature  is  that  the  number  of  observations  required  by  the 
procedure  is  not  determined  in  advance  of  the  experiment.  The  decision 
whether  or  not  to  terminate  the  experiment  is  made  at  each  stage  depending 
on  the  results  of  the  observations  made  up  to  that  point. 

The  major  difference  between  sequential  procedures  and  conventional 
fixed  sample  size  (FSS)  testing  is  that  the  sample  size  is  not  fixed  in 
advance.  In  the  conventional  fixed  sample  size  (FSS)  testing  of  a  simple 
hypothesis  Hq  against  a  simple  alternative  H^,  the  most  powerful  test  is 
given  by  Neyman- Pears on  lemma  (Van  Trees,  1968  page  34). 


...,xn) 


(x^ , • . . , xn) 


(1.1) 


where  f  (x.,...,x  )  and  f„  (x, ,  ...,x  )  are  the  joint  densities  of  the 
Hq  1  n'  1  n'  J 

random  variables  x^,...,xn  under  and  H^,  respectively  and  where 

x^,...,x  denotes  an  observation  of  X. , . . . ,X  .  The  sample  size  n  and 
in  in 

threshold  T  are  determined  by  the  level  of  significance  desired.  If  the 
sample  size  does  not  have  to  be  fixed,  then  a  sequential  probability  ratio 
test  (SPRT)  can  be  defined  (A.  Wald,  1947)  by  testing  the  probability  ratio 
against  two  thresholds  A  and  B,  i.e.,  we  continue  sampling  as  long  as 
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••••%> 


<  B 
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where  0  <  A  <  B  <  ®  and  stop  when  (1.2)  is  violated.  The  hypothesis  Hq  is 
accepted  if  the  ratio  is  less  than  or  equal  to  A,  and  the  hypothesis  is 

accepted  if  the  ratio  is  greater  than  or  equal  to  B;  and  the  thresholds  A 
and  B  are  chosen  to  give  desired  error  probabilities.  The  sample  size 
needed  to  reach  a  decision  is  a  random  variable  defined  as 


N  =*  min 


(*i  » •  •  •  ) 

■■  X, . *1 4  “•*> 

"H0  1  n 


(1.3) 


Under  general  conditions  P(N  <  «}  =*  1.  By  using  Wald's  approximation 
(which  assumes  the  actual  stopping  position  is  at  one  of  the  thresholds 
A  and  B),  it  can  be  shown  that  (A.  Wald,  1947,  p.  41)  we  may  choose 


8 

B  as  - 
or 


and 


(1.4) 


1-9 

1-a 


where  9  is  the  desired  power  and  or  is  the  desired  size  of  the  test.  Thus, 
via  (1.4)  one  can  choose  A  and  B  to  give  desirable  probabilities  of  error. 
We  may  also  want  the'  error  probabilities  in  terms  of  boundaries;  i.e.. 


a  2- 


3  2= 


1-A 

1-B 

Bd-A) 

B-A 


(1.5) 


It  is  important  to  note  that  these  approximations  to  the  error  probabilities 
of  a  given  SPRT(A,B)  are  independent  of  the  distributions  of  the  data  under 
Hq  and  H^. 
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1.2  Operating  Characteristics  and  Expected  Sample  Size  Functions 

Throughout  this  section  we  consider  only  the  independent  sampling  case. 
Also,  it  is  assumed  that  the  samples  x^  are  identically  distributed  with 
distribution  known  except  for  the  values  of  a  finite  number  of  parameters 
6^,... ,8^.  We  use  the  letter  6  without  subscript  to  denote  the  set  of  all  k 
parameters  9^,..., 9^.  Since  the  distribution  of  each  x^.is  determined  by  the 
parameter  point  8,  the  probability  of  accepting  Hq  will  be  a  function  of  8. 
This  function  is  denoted  by  L(9)  and  is  called  the  operating  characteristic 
(OC)  function. 

Now,  we  consider  the  sequential  probability  ratio  test  for  testing  a 
simple  hypothesis  Hq  against  a  simple  alternative  .  Let  f(x,8)  denote 
the  common  probability  density  function  of  random  variables  x^.  Consider 
the  following  hypothesis  test: 

Hq:  x±  ~  f(x,8Q)  all  i 

vs  (1.5) 

H^:  X£  ~  f(x,8^)  all  i  . 

Consider  the  expression 


For  each  value  9,  a  value  of  H(8)  can  be  determined  such  that  the 
expectation  of  (1.6)  is  equal  to  1,  i.e., 


(1-6) 


(1-7) 
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Neglecting  the  excess  of  likelihood  ratio  over  the  boundaries  A.  and  B  at 
the  termination  of  the  process,  and  with  Eq.  (1.7),  an  approximated  OC 
function  can  be  shown,  to  be  (Wald,  1947,  p.  48), 

„h(9) 


-  1 


L(9) 


Bh(9)  _  aM9) 


L°g  B 


Log  A  +  Log  B 


h(9)  4  0 


h(9)  =  0 


(1.8) 


and  the  expected  sample  size  can  be  shown  to  be 


D 


Eq(N) 


L(9)Log  A  +  f  1-L(9)  iLog  B 
E0(Z) 


V 


Log  A  Log  B 
Ee(Z2) 


,  E0(Z)  *  0 


,  Eq  (Z)  =  0 


where  Z  »  In 


(1.9) 


f  f(x,01)  ] 

f(x  9  ') j  and  E9^*^  denotes  expectation  with  respect  to  the 


density  f (x,9) . 

1.3  Comparison  Between  FSS  and  SPRT 

The  advantages  of  SPRT  over  the  FSS  are  that  the  thresholds  A  and  B 

are  easier  to  choose  than  are  T  and  N.  For  controlling  both  probabilities  of 

error  under  Hn  and  H.. ,  and  that  the  expected  sample  sizes,  E  (N)  and 
u  i 

E^  (N),  under  Hq  and  H^,  are  smaller  than  the  sample  size  N  needed  for 

the  same  probability  of  error  with  FSS  test. 

There  are  some  drawbacks  to  the  SPRT,  one  of  which  is  that  a  more 

complicated  implementation  scheme  is  needed.  However,  this  disadvantage 

can  be  compensated  for  by  saving  in  £„  (N)  and  E  (N)  (A.  Wald,  19<W  p.  3 

rtl  H0 
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gives  an  example  on  saving  in  average  sample  size  of  an  SPRT  compared  Co 
Che  besC  FSS  CesC  of  abouC  fifty  percenC) .  Even  Chough  Che  SPRT  has  been 
shown  Co  cerminace  with  probability  one,  occasionally  a  tesc  can  go  on  for 
a  long  Cime  before  ic  stops.  This  excessive  test  length  is  usually  solved 
by  truncation  (see  S.  Tantartana,  1977).  If  the  test  is  truncated  at  a 
reasonably  large  sample,  then  its  properties  are  essentially  unaffected 
by  the  truncation.  One  other  drawback  of  the  SPRT  is  that  Eg(N)  can  be 
very  large  for  some  values  of  parameter  6.  Under  small  probabilities  of 
errors,  this  situation  can  become  worse.  Several  schemes  can  reduce  Eg(N); 
such  as  truncating  the  test,  modification  of  the  thresholds  A  and  B 
(T.  W.  Anderson,  1960),  the  minimax  scheme  (T.  L.  Lai,  1973),  and  the 
generalized  SPRT  (J.  Kieffer  and  L.  Weiss,  1957). 


CHAPTER  2 


MEMORYLESS  SEQUENTIAL  DETECTION  SYSTEM 
The  memory less  detector  for  a  constant  signal  in  m-dependent  noise 
under  the  conventional  fixed  sample  size  have  been  studied  previously  by 
H.  V.  Poor  and  J.  Thomas,  (1979).  It  is  shown  that,  for  the  case  of 
large  samples,  an  optimum  nonlinearity  can  be  obtained  by  solving  the 
Fredhold  integral  equation  of  the  second  kind,  and  its  driving  function 
is  an  optimum  solution  for  the  independent  case.  In  this  chapter,  we 
extend  the  work  of  Poor  and  Thomas  to  the  design  of  a  sequential 
memoryless  detector  by  using  average  sample  size  as  the  performance 
measure. 

2.1  Problem  Definition  and  Detector  Structure 


In  this  section,  the  problem  of  designing  memoryless  sequential 
detection  systems  for  a  constant  signal  in  m-dependent  noise  processes 
is  considered.  A  stationary  random  sequence  is  said  to  be 

m-dependent  if  and  {N^}?_^  are  statistically  independent  for 

|  s  5  ^  1  satisfying  §-$  >  m,  which  is  a  nonnegative  integer.  An 
m-dependent  sequence  is  obtained,  for  example,  by  sampling  Caussian 
processes  whose  autocorrelation  functions  have  finite  support  or  the 
output  sequences  from  finite-impulse-response  filter  with  white  inputs. 

In  general,  the  construction  of  detectors  based  on  m-dependent  noise 


require  a  finite  memory  length.  In  some  cases,  it  may  require  unreasonably 
large  lengths  of  memory  if  m  is  large.  In  this  section,  we  consider  the 
procedures  which  give  the  best  performance  among  all  memoryless  schemes. 
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To  study  this  problem,  we  consider  detecting  a  known  constant  signal 


in  an  additive  m-dependent  noise  process.  We  have  a  sequence  ~  x 

of  observation  of  a  process  3  X  and  we  wish  to  test  the  antipodal 


hypothesis , 


versus 


Ha:  X.  -  N -  S  i  -  1,. ..,n 
0  i  i 


H. :  X.  »  N.  +  S  i  -  l,...,n 

1  J.  3. 


(2.1) 


where  is  a  zero-mean  stationary  m-dependent  noise  sequence  and  S 

is  a  known  positive  constant.  We  will  assume  that  f,  the  common  univariate 
density  of  the  noise  sequence,  is  symmetric  and  strictly  positive  on  the 
entire  real  line. 

We  wish  to  consider  only  the  memoryless  implementation  of  detection 
systems  for  (2.1).  A  sequential  memoryless  detector  can  be  represented 


in  the  following  stopping  mile. 


<p(g;x) 


0  ;  if  A  <  X  (x)  <  B 
8 


1  ;  otherwise 


(2.2) 


where 


T  (x)  =  2  g(x. ) 


(2.3) 


Here  A  and  B  are  the  boundaries  satisfying  0  <  A  <  B  <  ®,  and  g(*)  is  a 

memory less  nonlinearity.  The  test  of  Zq.  (2.2)  and  Eq .  (2.3)  continues 

sampling  as  long  as  T  (x)  stays  strictly  between  A  and  B,  and  if  T  (x)  <  A, 

g  g 

hypothesis  Hq  is  accepted,  whereas  if  T^(x)  s  B,  hypothesis  is  accepted. 
The  boundaries  A  and  B  are  chosen  to  give  desired  error  probability 
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performance,  and  cp(g,x)  is  the  probability  with  which  we  stop.  The 
diagram  of  the  detector  structure  is  shown  in  Fig.  1,  which  shows  the 
samples  are  passed  through  a  nonlinearity  g,  summed,  and  then 

compared  to  the  thresholds. 

2.2  Asymptotic  Property  of  T 

& 

In  order  to  analyze  the  performance  of  the  detection  system  described 

in  (2.2),  it  is  necessary  to  know  the  asymptotic  distribution  of  the  test 

statistics  T  (x) .  We  may  apply  a  central  limit  theorem,  and  under  some 
S 

mild  conditions  T^(x)  converges  to  normality  under  both  Hq  and  In 

particular,  we  may  establish  the  convergence  of  the  test  statistics  to  a 
Brownian  motion  by  applying  the  following  theorem  of  (Billingsley,  1968,  p. 


Theorem  2.1.  (Billingsley.  1968).  Let  Y^,Y2,...,  be  a  cp-mixing  sequence 

of  random  variables  with  £  cp^  <  «,  where  (cp  ]  are  the  mixing  coefficients, 

n 

and  assume  g  is  a  measurable  function  satisfying 


E(g(Y1)}  -  0  and  Etg2^)}  < 


Define 


Sn  =  Z  §(V 

n  i-1  1 


(2.4) 


2  _ 2 


aQ  =  Etg^(Y1)}  +  2  £  E[g(Y1)g(Y  p} 

j=l  J 


(2.5) 


Then,  if  >  0,  the  sum 


U  (t)  = 
n  ^ 


0  <  t  <  1 


converges  as  n  -»  •  Co  a  standard  Brownian  motion  with  zero  mean  and 
variance  t  in  [0,1]. 

Recall  that  the  definition  of  a  cp-mixing  process  is  given  by: 
Definition  2.1.  Let  . . . ,Y_^,Yq,Y^, . . .  be  a  strictly  stationary  sequence 
of  random  variables  defined  on  a  probability  space  (p ,  PI Zor  _a  — -.b_, 
denote  T/t  as  the  o-field  generated  by  the  random  variables  Y  , . . .  ,Y, 

cL  cL  D 

(likewise  77?  is  the  a-field  generated  by  . . .  ,Y  .  ,Y  )  .  Then  for  a 

3"  1  A 

nonnegative  function  cp  of  positive  integers,  we  say  that  the  sequence 
CYn)  is  cp-mixing  if,  for  each  k(-«  <  k  <  *)  and  for  each  n(n  ^  1), 

If  OB 

€  771  ^  and  E 2  €  5^  together  imply 

|P(E1  0  E2)  -  P(E1)P(E2)|  <  cp(n)P(E^)  (2.6) 

with 

lim  <p(n)  *  0. 
n  —  ® 

We  can  see  that  if  cp(n)  is  small,  then  E2  is  virtually  independent  of 
E^  (weakly  dependent).  Since  an  m-dependent  sequence  (cp(n)  *  0,  for 
n  >  m)  is  also  a  cp-mixing  sequence,  the  above  theorem  automatically  holds 
for  an  m-dependent  sequence.  We  now  restrict  the  system  (2.2)  by 
considering  only  those  detectors  based  on  nonlinearities  which  satisfy 
the  following  mild  conditions: 


and 


Eg{g(X1)}  -  0 

(2.7a) 

VarQCg(X1)3  <  “ 

(2.7b) 

|Ee[g(X1)}|  <  » 

(2.7c) 

*e2(g) 


m 


Y  9  €  9 


9-0,1 


(2.7d) 


12 


where  the  subscript  9  denotes  expressions  computed  under  when  0*1, 
under  Hq  when  9*0.  Under  the  above  conditions,  we  have  from  theorem 
(2.1),  that 


(T  (X)  -EqCt  (X)}) 


(2.8) 


is  asymptotically  normally  distributed  with  mean  zero  and  variance  aQ(g). 


In  other  words,  T  (x)  is  statistically  equivalent  to  £  Y. ,  when  Y. 

8  i*l  1  L 

are  independent  identically  distributed  with  means  )j.Q(g),  and  variances 

2 

cr  (g)  .  The  importance  of  setting  T  to  be  a  collection  of  independent 

^  O 

observations  is  that  it  allows  us  to  study  performance  (which 
is  the  average  sample  size)  under  the  method  of  Wald's  Fundamental 
Identity  in  the  following  section. 

2 . 3  The  Criterion 


As  we  noted  in  the  previous  sections,  the  sequential  probability  ratio 
test  (SPRT)  minimizes  average  sample  size,  under  hypothesis  and  alternative. 
The  criterion  for  our  design  is  the  average  sample  size  which  already  has 
been  approximated  by  Wald. 

In  order  to  proceed  with  the  analysis  of  the  criterion,  it  is  necessary 
to  know  the  Fundamental  Identity  of  Sequential  Analysis  (see  Ferguson,  1967, 
p.  373)  which  stated  as  follows: 

Theorem  2.2.  Let  be  independent,  identically  distributed, 

finite-valued  random  variable.  Define 


S  =  £  Z. 

n  .  .  l 
r*l 


(2.9) 


and  assume 


t 
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i  : 


a 

i 


V 

D 


p{zi  »  0}  4  1,  p[|zi|  <  »}  *  1 

then 

ECexp(tSN)M(t)“N}  *  1  (2.10) 

for  all  t  for  which  M(t)  is  finite.  Here  M(t)  denotes  the  moment 
generating  function  of  the  common  distribution  of  Z^,  i.e., 

M(t)  »  E[exp(tZ^) } ,  (2.11) 

and  N  is  defined  in  Eq.  (1.3). 

The  advantage  of  using  the  Fundamental  Identity  is  that  we  may  use 
Wald's  approximation  of  error  probabilities  and  expected  sample  size  under 
an  arbitrary  distribution  of  the  independent  identically  distributed 
sequence . 

Note  that  if  we  can  find  a  nonzero  real  number  tQ  for  which  M(tQ)  =»  1, 
then  the  Fundamental  Identity  implies 

E[exp(t0SN)}  -  1  (2.12) 

We  may  then  use  (2.12)  to  approximate  the  error  probabilities  by 
ignoring  the  excess  over  the  boundaries;  that  is,  (see  Ferguson,  1967) 

exp(tQa)P{SN  <  a}  +  exp(tQb)P{SN  s  b}  s-  1  (2.13) 

where  a  =  log  A,  b  =  log  B  from  which  we  may  solve  for  P(SN  s  b}  and 
P{s^  ^  a}  by  substituting  P{s^  ^  b}  *  1  -  P(s^  S  a}.  We  obtain 

1  -  exp(t.a) 

1  N  ;  exp(tgb)  -  exp(tQa) 


t 


(2.14) 


and 


exp(t  b)  -  1 

pfc  <  a1  2:  - - - 

1  N  1  exp(tQb)  -  exp(tQa) 


(2.15) 


Now  the  approximations  for  the  expected  sample  size  function  can  be 
obtained  by  using  Eq.  (2.14)  and  Eq.  (2.15)  and  the  following  theorem. 
Theorem  2.3.  (Ferguson,  1967).  Assume  that  P(Z^  *  0}  4  1,  P C | |  <“3*1, 
and  that  M(t)  exist  in  a  neighborhood  of  the  origin.  Then 


(a)  ESn  -  nEN 

(b)  E(Sn  -  NH)2  -  <72EN 

2 

where  u  =  EZ^  and  a  »  Var  Z^. 

Then  the  approximated  sample  size  function  is  as  follows: 
For  Hg  ^  0,  then 

Ee<N)  -  ^  e[sn}  a  ji  CaPtSK  <  a]  +  bP{sN  a  b}} 

9  9 

1  a{exp(tgb)  -  1}  +  b(l  -  exp(tQa)} 

~  (exp(tQb)  -  exp(tQa) J 


(2.16) 

(2.17) 


(2.18) 


For  Hg  =  0,  then 

ES(N)  .  -i  E[S2}  =  -i  U2PCs„  S  a]  +  b2PlSN  (2.19) 

a8  CT0  ‘  ae 

2 

for  all  9  €  ®,  and  where  and  Hg  are  the  variances  and  expectations  of 


Z.  under  and  H,  . 

i  0  * 
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Applying  the  above  to  our  case  (Eq.  (2.3)),  where  we  represent 


B 


n  A 

T  (x)  -  £  Y.  -  T 
8  i-1 

with  the  Gaussian.  The  moment  generating  function  of  is  given  by 

(2.20) 


M(t)  =  exp{t  u> (g)  +  tf2(g)  -^3 


where  (j. ( • )  and  a  (•)  are  the  expectation  and  variance  with  respect  to 
density  function  of  X.  For  a  non- trivial  solution  (t  ^  0)  of  M(t)  »  1, 
we  get 

t2  . 

expCt^i(g)  +  <J*(g)  3  =  1  ,  tQ  +  0 


t  ,  .  Msl 
0  2,  \ 
(g) 


(2.21) 


Substituting  Eq.  (2.21)  into  Eqs.  (2.14)  and  (2.15)  we  obtain: 

P(T  S  b]  2: 


i  .  expt.  2Msl  ] 

<rw 


and 


exp{-  —fo ^  3  -  exp{2^^8^  3 

(g)  a  (g) 


exp(-  2^U‘  ^  3-1 


(2.22) 


p{T  <  al  =■  -  •'  - 

n  '  ^  '  exp£-  ^  3  -  exp£-  ] 


(2.23) 


(g) 


*  (g) 


Since  P(lN  s  b]  *  p£  Choose  H^3  and  p£l^  <  a]  =  P{Choose  H^} ,  we  can  find 
approximate  error  probabilities  from  (2.22)  and  (2.23);  that  is. 
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2a4,(8) 

1  -  exp{  -  — 5 -  3 

cr^(g) 

ZbM-j^Cg)  2ap.1(g) 

exp{-  — = -  }  -  expC - 2 -  3 


(2.24) 


<^(g)  <^(g) 

.  f  2a^0C*>  , 

1  -  expl - 5 -  j 

_ ^Cg) _ 

2bM.  (g)  2ay.n(g) 

exp{-  -sS—  }  -  exp£-  1 

*;<g)  ao(s> 


(2.25) 


In  view  of  the  i.i.d.  optimal  detection  structure,  we  may  assume  that  g 
is  an  odd -symmetric  function  about  zero.  We  also  assume  that  the  second- 
order  noise  density  is  symmetric.  Then  we  have  the  following  properties: 


M.0(2>  *  J*  g(x)f (x-s)dx  =  J  g(x+s)f(x)dx 


J  g(-x-s)f (-x)dx 


-  J  g(x) f (x+s)dx 


-  M-X(g) 


(2.26) 


J  g2(x)f (x-s)dx  *  J  g  (x+s)f(x)dx 


=  J  (-g(-x-s))"f (-x)dx 


=  f  g  (x)f  (x-f-s)dx 
0 


(2.27) 


I 
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c 

D 


I 

Q 


2  2 

and  furthermore,  we  would  like  to  show  CT^g)  *<J0(g).  From  Eq.  (2.7d)  we  have 


m 


where 


crQ(g)  =  VarQ(g)  +  ,g(Xj+1) ) 

2  tn 

^(g)  *  Var^g)  +  2^Cov1(g(X1),g(Xj+1)) 


VarQ(g)  »  Ee(g2)  -  Eg(g) 


substituting  Eqs.  (2.26)  and  (2.27)  into  Eq.  (2.30),  we  find 

VarQ(g)  a  Varx(g). 

Now  the  problem  is  equivalent  to  showing 

m  m 

^Cov0(g(Xrg(Xj+1))  »  r^Cov1(g(X1),g(Xj+1)). 

After  some  analysis  we  obtain 


(2.28) 


(2.29) 


(2.30) 


L  i  8(V l>f!.1,N.+1(!tl+!’-Vl+S)<JXldVl 

09  00 

*  L  L  (2-31) 

Using  the  properties  of  g  (that  is  <r2(g)  =a2(g)  and  -^(g)  =*p.Q(g)) , 
substituting  them  in  Eq.  (2.18),  we  eliminate  the  boundaries  a  and  b; 
and  conditioning  on  Hq  and  H^,  we  obtain  the  following  expressions: 
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E(n|h.)  2: 


gQ(g> 

M.Q<g) 


M 


M  -  4 

a\  »l 


*n(S> 


(2.32) 


where  KQ  =  ^(l-a)log(-~)  +  *salog(|-) 


»?(g) 


®?<g) 


CTi'>g')  r  i-a  si 

E(NjH  )  3,  l  %(l-P)log(l^)  +  tflog(|)  -  -f— ■  K  (2.33) 

M-X(g)  L  J  M*1(g) 

where  K-  =  %(1-P)  log(~:^-)  +  J$log(-). 

1  L-a  a 

We  would  like  to  find  the  optimum  nonlinearity  g  to  minimize  average 
sample  size  under  both  Hq  and  H^.  Assuming  g  satisfies  the  constraints 
defined  in  previous  sections,  we  see  that  to  minimize  E(n|Hq) 


is  equivalent  to  maximizing 
criterion  as  follows: 


2,  ^ 

^Q(S) 

ge<g> 


,  so  we  may  define  the  performance 


>V£_ 

V8) 


,  v  e  €  0 


(2.34) 


A  A 

Since  <Jg(g)  =  cr^ (g)  and  -u^g)  =  ^Q(g),  to  minimize  E(n|hq)  for  both  9=0 
and  9  =  1  is  equivalent  to  maximizing  the  criterion  S (g)  for  9  =  0  or  1. 

Now  a  question  arises,  since  the  asymtotic  approximation  of  test 
statistics  is  used,  how  accurately  can  we  determine  the  nonlinearity  g? 
This  problem  is  carefully  examined  in  detail  in  Chapter  3. 

2.4.  A  Necessary  and  Sufficient  Condition 

As  we  defined  in  section  2.3,  the  criterion  we  used  is 


S(g)  - 


gf9^ 

?a(§) 


9  =  0,1. 
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0 

II 


a 


* 


2 

where  ^gC*)  is  the  variance  as  we  defined  in  (2.7d),  and  fg  is  the 
univariate  observation  density  under  Hq  and  H^. 

We  can  see  from  Eq.  (2.34)  that  the  optimum  choice  of  will  be  that 
g  which  maximizes  the  criterion  S (g) ,  i.e., 

8o a  argtgT^ s(s)}  (2-35) 

where  It  is  the  class  of  g  which  satisfying  the  restriction  and  the 

assumption  we  defined  in  previous  sections. 

We  note  that  S(g)  is  invariant  to  scaling  (i.e.,  S (g)  =  S (ag)  for 

2 

a  4  0)  so  that  maximizing  S(g)  is  equivalent  to  maximizing  (J'gfg)  under 

2 

the  constraint  that  cs^  (g)  is  equal  to  a  constant.  Then  Eq .  (2.35)  is 
equivalent  to 

gQ  -  argC^ j  H(g)}  (2.36) 

where 

H(g)  -  Jgfg  +  X<?g(g) 
and  X  is  a  Lagrange  multiplier. 

Defining 

J  (€)  -  H(g  +  €og)  (2.37) 

where  6 g  is  an  arbitrary  variation  in  g,  we  have  a  necessary  condition 
for  to  solve, 

J'  (0)  =  0  ,  for  arbitrary  og  .  (2.38) 

s0 

We  consider  Eq.  (2.36)  under  (which  is  equivalent  to  the  case 


» 


under  Hq)  i.e.. 


consider 


80  -  arg{  m^xJ({J,gf(x-s)dx  +  Xff^g)]} 


H(g)  -  J*gf(x-s)dx  +  XffL(g) 


(2.39) 


We  write  it  in  explicit  form. 


CO  o  ui  03  W 

H(g)  =  J*  g(x)f (x-s)dx  +  X  J  g  (x) f (x-s)dx  +  2Z  J  J  g(x1)g(x  ) 

-CD  „  —CD  -DO  —03  * 

2l 

fN  N.  <x1-s»xj+1-s)dx1dxj+1”(2lttfl)  (J  g(x)f(x-s)dx)  I 


(2.40) 


We  now  use  the  symmetry  properties  of  g  and  f,  rewrite  it  in  the  following 


H(g)  *»  J  g(x)f (x-s)dx-P  g(x)f(x+s)dx  +  X  if  g  (x)f(x-s)dx  +  I  g  (x)f(x+s)dx 

0  0  L  0  0 

m  /  00  ea  ®  00 


+  2Z,  U„  J’ns<!‘i)8(sj+i)fN,,N.i,(,'rs’!!j+i's)dxi<i,tj+i'  -T  J’ns(,'i) 

j»l  0  0  1  J+1  *  00 

as  « 

8<Itj+l)£N1.N.+1CXl'S,Vl+S)dXldVl'  ^  J'0S(Xl)8(Xj'H)£N1,N.+1 


ao  ao 
r»  r» 

I  n 


feiw’Vi'*,d*idVi  +  J0  J08(!'i)8(xj4-i)fN1,fi.+1(xi+s"Vi+3> 

dx.dx  ,  1  -  (2»H-1)  (<  g(x)f (x-s)dx-  f  g(x) f (x+s)dx\  1 


(2.41 


I 
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then  substitute  g  *  g  +  s6g  in  Eq.  (2.41)  and  take  derivative  with 
respect  to  e  .  We  obtain, 

CO  03  CD 

— — =  :  5gf(x-s)dx  -  j  5gf(x+s)dx  +  \  ;  2j  (g  +  sog)ogf (x-s)dx  +  2 
0  0  ^  0 


j  (g  +  eog)6gf (x+s)dx  +  2  £  J  2  j  j  (g  +  e6g)6gf  (x.-s,x .-s) 

0  j-l]  0  0  Nl’  j+1  1  1  1 

03  00  00  03 

dsidxj+r2  !0  JV8  +  *6*)6gfHl.Mj+1<V'Vi+,)dxi*'j+i ' 2  -r0  % 

03  03 

(g  +  e5g)6gf  (x  +s,x  -s)dx  dx  +  2  j*  J  (g  +  e6g)6 gf 

1’  j+1  J  J  0  0  l’1  j+1 

(x.+s,x. , ,+s)dx.dx. , . 1  -  2(2mfl);  f  5gf(x-s)dx  -  f  6gf(x+s)dx\ 

1  j+1  1  j+1/  y  0  0  ) 

(  *  »  v  - 

U  (g  +  e6g)f(x-s)dx  -  J  (g  +  e6g)f (x+s)dx  ]  j  (2.42} 

N  0  0  /  J 


(2.42) 


Then  we  sat  e  =  0,  and  after  some  manipulations  we  have 


m  I  <= 


j' (0)  =  f  J f(x-s)-f (x+s)+2X[g(x)f (x-s)+g(x)f (x+s)+2  Z  <j  g(x  ,)f 
8  0  j-l  0  ll’  j+1 

V  ob  -  oo 

-0  lVVj*i<’'1",^1+8,V -0  8<xj+i> 

08  *) 

\,NJ+1(xi*-Vi'*)dVi*  J’0  *<x>i)fN1,s.+1ui*s’xj+rs)dxj^| 

09  =0  CD  J 

-(2nrt-l)  (f  (x-s)  J1  f  (u-s)g(u)du-f  (x-s)  ”  g(u)f  (u+s)du-f  (x+s)u  g(u)f(u-s) 

0  ^  uo  “o 

du+f(x+s)f'  g  (u)  f  (u+s)du)  1  V  ^  g(x)dx  (2.43) 


du+f(x+s)  g(u) f (u+s)du) ] ?  5g(x)dx 

■°  J 
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where  is  the  joint  probability  density  function  of  and  N^+^. 

Since  fig  is  arbitrary,  J' (0)  will  be  zero,  if  and  only  if,  the  quantity 
in  the  brackets  [...}  is  identically  equal  to  zero-  After  arrangement 
we  have , 


g(x)+2X  J’  K(x,y)g(y)dy  =  -2Xg(x) 
0 


T  x  €  (-»,») 


where 


s  (x)  =  k Lzlzl 

SV '  L(x)+1 


(2.44) 


(2.45) 


K(x,y)  =2^<E  (f  (x-s.y-s)-f  (x-s,y+s)f  (x+s,y-s) 

1  |j=l  1’  j+1  V  j+1  "^’"j+l 

+f  (x+s,y+s))/(f  (x-s)+f(x+s))-Q(x,y)l-Q(x,y)  V  (2.46) 

"i’Vi  J  j 


where 


Q(x,y)  *  g (x)(f(y-s)-f(y+s)) 


L(x)  = 


f (x+s ) 


(2.47) 


(2.48) 


Here  g(x)  is  a  driving  function  and  K(x,y)  is  the  kernel. 

A  sufficient  condition  for  to  maximize  S  (g)  is  that  Jgg(e)  <  Jg^(0) 
for  arbitrary  5g  and  s.  We  have  (details  see  Appendix) 


Jg(s)  =  J  (0)  +  sj'(0)  +  \(s  ffj(og)) 


If  gn  satisfies  (2.44),  we  must  have 


(2.49) 


J2  (S)  =  (0)  “*■  X(s  ,JT(5S))  ^  J  (0) 

s0  °0  1  s0 

for  all  s  and  5g,  we  conclude  that  X  is  negative.  Then  wich  negative  X 
both  necessary  and  sufficient  for  g^  to  maximize  S (g) . 


* 
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Since  X  is  arbitrary  (but  negative),  we  may  choose  X  =  by 
analogy  with  the  case  in  which  the  kernel  is  identically  zero  (equivalent 
to  the  independent-sampling  case),  we  then  have  (2.44)  in  the  form 

as 

g(x)  -  J  K(x,y)g(y)dy  =  g(x)  (2.50) 

0 

which  is  a  Fredholm  equation  of  the  second  kind.  In  Chapter  4  we  give 
the  solution  for  this  integral  equation. 
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CHAPTER  3 

COMPARISON  BETWEEN  TANH(^|^)  and  Log  L 
In  this  section,  the  problem  of  a  paradox  which  arises  from  the 
development  of  standard  asymptotic  analysis  to  sequential  signal  detection 
systems  is  considered.  The  asymptotic  analysis  of  the  test  statistics 
leads  to  an  optimum  nonlinearity  which  seems  to  contradict  the  well- 
known  Wald-Wolfowitz  theorem.  Moreover,  this  situation  can  be  extended 
to  general  detection  systems.  In  other  words,  an  analogous  paradox 
exists  in  the  likelihood- ratio  process  which  seems  to  contradict  the 
Neyman-Pearson  lemma  and  Baysian  theory. 

3 . 1  The  Optimum  Nonlinearity  TANH( (LogL) /2) 

Consider  Eq.  (4.7),  if  we  set  m  *  0,  in  which  kernel  is  identically 
zero,  then  it  reduces  to  the  independent -samp ling  case.  The  solution  for 
the  optimum  nonlinearity  gg  of  this  integral  equation  is  proportional  to 
TANH( (LogL) /2)  (which  can  also  be  written  as  (L-1)/(L+1)) .  When  L(x) 
is  defined  in  Eq.  (4.11)  this  seems  to  contradict  the  well-known  Wald 
and  Wolfowitz  theorem  (see  A.  Wald  1947)  which  proves  that  Log(L)  is  the 
optimum  nonlinearity  function  that  minimizes  the  average  sample  size 
under  both  Hq  and  H^.  Now,  it  is  necessary  to  show  that  our  nonlinearity 
TANH( (LogL) /2)  is  the  optimum  solution  for  the  independent-sampling  case, 
under  our  criterion  S (g) . 

Consider  our  new  detection  hypothesis: 


vs  . 


H0:Xi 


i  =  1, . .  .  ,h 


H,  :X. 

1  l 


N.  +  s 

l 


i  =  1,  .  .  .  ,h 


(3.1) 


where  is  a  zero  mean  i.i.d.  noise  random  sequence,  and  is  Che 
common  univariate,  even  symmetric  noise  density,  s  is  a  known  positive 
number.  Again  assume  g  is  an  odd  symmetric  function  about  zero,  then  we 
have  the  properties : 

CO  CD 

M-0(g)  -  j'  g(x)fN(x+s)dx  =*  J  g(x)fN(x-s)dx  =  ^(g)  (3. 

-CO  -CO 

and 

so  as  _ 

M-qCs2)  =  J  g2  (x)  fN  (x+s )  dx  =  J  g2(x)fN(X-s)cx  =  □>1(g2) 

—CO  >ao 

or 

tf2(g)  -  <*2(g)  •  (3. 

V  9  6  ©  (3 . 

V  9  €  ©  (3.. 


Similarly  the  sample  size  that  is 

CTg(g) 

VN>  *  2  ^  ’ 

M.g(g) 


and  again  our  criterion  is 


S(g) 


a9(s) 


2 


Again,  to  maximize  S (g)  under  is  equivalent  to  maximize  S (g)  under  Hq 
so  that  we  can  write 


S(g)  = 


^‘1(g)  1 

0'1Cs) 


(3. 


Mow,  we  would  like  to  show  that  the  =  TANH( (LogL) /2)  is  the 
function  maximizing  S (g)  for  the  independent  sampling  case. 


Consider  the  following  theorem: 
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Theorem  3.1.  Suppose  is  the  class  of  all  odd -symmetric  nonlinearities 


satisfying 


Then 


^(g  )  < 


■  2 

^(g> 


max  1'°' 
ars  {  g  €  J,  1 - 

S  crUs) 


=  =  TANH(i2fi;) 

L+l  ^  2  ' 


(3.6) 


where  L  is  the  single  sample  likelihood  ratio  defined  by 

.  .  .  £N(lt-S) 


fN(x+s) 


Proof.  Suppose  u^(g)  is  not  identically  zero,  then 
a  maximum  over  and  we  can  write 


will  have 


2 ,  . 
P^Cg) 

v2L(g) 


2.  \ 
P-j^g) 

7T  2~~ 

p-l(g  )  -  p-jiCg) 


ul 


p^Cg2) 

^2(g) 


so  that  maximizing  - s -  is  equivalent  to  maximizing 

<^(g) 

2  .  , 

a  (8) 

W(g)  s  - 7 

P-1(g  ) 


To  write  the  above  equation  in  explicit  form,  we  have 


W(g)  * 


(3. 


gCxJf^x-s^x  j, 

00 

J  g2(x)fN(x-s)dx 


Since  g(x)  is,  by  hypothesis,  an  odd  function  of  x,  and  g  (x)  is  an  even 
function  of  x,  we  have 
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M^Cg)  ■  J  g(x)f  (x-s)dx  -  J'  g(x)f  (x-s)dx  -  J  g(x)f  (xfs)dx 

0  0  N 


•T0|*(x)(ruHi  )j-[£N(!!-s)+f!i(’M-s)ldx  <3-( 


and 


)  3  j  8  (x)f  (x-s)dx  **  J  g  (x)f^(x-s)dx  +  j*  gZ(x)f  (x+s)dx 
-«  0  0  N 


2 

=  J  g  (x) t fjj (x~s )  +  fN(x+s)]dx  . 


(3.9 


Substituting  (3.9)  and  (3.8)  in  (3.7),  we  then  have 


W(g)  = 


I  «r 


(3.] 


g  (x)[fN(x-s)  +  fN(x+s)]dx 


Applying  Schwarz's  inequality,  i.e., 


q(x)h(x)dx  j  —  j  q  (x)dx  J  h  (x)dx 


to  the  numerator  of  (3.10)  where 


q(x)  “  g(x)lfN(x-s)  +  fN(x+s)]^ 


h(x)  4  t£N(x-s)  +  £n(x+s>1% 


wc®»  -  X0  [tw^]2‘£N 


(x-s)  +  fN(x+s)]dx 


(3.11) 


with  equality,  if  and  only  if  g^(x)  =  V  /  l(x)+1  'y  ‘  *c  can  easi-^y  shown 

L(x)-1  '  ' 

that  -■  is  an  odd  symmetric  function,  which  agrees  with  our  previous 

assumption.  For  some  real  a  4  0,  we  have  the  optimum  nonlinearity,  i.e., 

utkr  -  TAOTf  t*4) 


Q.E.D. 

From  the  above  proof,  we  can  say  that  TANH  ^  ^  indeed  is  the 

optimum  nonlinearity  under  our  criterion.  Now  a  paradox  arises  since 
TANH  ^  ^  and  LogL  are  both  derived  to  be  optimum  under  the  same 

hypothesis.  To  resolve  this  paradox,  we  must  trace  back  to  Chapter  2. 

Because  if  we  assume  asymptotic  normality  of  the  detection  statistics 
and  use  the  approximated  average  sample  size  as  our  criterion,  then  it 
is  understandable  why  they  are  different,  since  LogL  is  derived  under  the 
actual  expression  of  sample  size  and  without  using  asymptotic  approximation 


properties  of  the  test  statistics.  However,  in  general  for  the  case  of  large 


sample  size,  asymptotic  approximations  for  the  test  statistics  are  often 


f 
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accurate  and  the  approximated  criterion  are  widely  used  and  acceptable. 
Since  they  are  different,  we  also  would  like  to  compare  their  performance 
which  is  the  average  sample  size,  under  a  given  test.  The  details  and 
numerical  results  are  presented  in  the  next  section. 

3 .2  Numerical  Results  and  Examples 

In  this  section,  we  compute  the  sample  size  for  the  two  nonlinearities 

2 

under  different  noise  densities.  We  also  use  signal  (s),  variance  (a  ) 
and  error  probabilities  (a  and  £)  as  our  parameters. 

Several  noise  densities  are  examined; 

(a)  Generalized  Gaussian  noise: 

This  probability  density  function  is  defined  by 


f  (x)  -  [cTl(CT,c)/(2r(l/c))]exp{-[Tl(a,c)|x|]C} 


(3.12) 


where 


Tt(cr,c)  =  cr"1[r(3/c)/r(l/c)]^ 


Here  c  is  a  positive  parameter  controlling  the  rate  of  decay,  !"(•)  is 

2 

the  gamma  function,  and  c  is  the  noise  variance.  Note  that  for  c  =  2 

this  density  reduces  to  the  Gaussian  density,  whereas  for  c  =  1  it  becomes 

the  Laplace  density.  The  density  of  (3.12)  is  illustrated  in  Fig.  2  for 
2 

values  of  a-  =1,  and  c  =  1.5,  2,  and  3.  Now,  we  substitute  Eq.  (3.12)  in 
Eq.  (3.6)  to  obtain 


L(x)  3  fC  (x+s )  =  e:cpt“  (lx"s|C  -  |  X+S  I  C )  } 


(3.13) 


I . 


R 

t 


f! 


El 


and 


TANH 


where 


TANH 


^  <lx  ‘  sl°  ‘  lx  +  s|C) 


YC(c) 


r(3/c) 

r(i/c) 
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(3 . 14) 


Substituting  Eq.  (3.13)  and  Eq.  (3.14)  in  Eq.  (3.4),  then  we  approximate 
E^(N).  Also  for  c  =  2,  the  nonlinearities  are  plotted  in  Fig.  9.  The  sample 
size  ratio  between  TANH  and  L0gL  under  H^  is  defined  as  follows 

E. [N|TANH(LogL/2) ] 

Ratio  *  R  *  -7 -  (3.15) 

E^NlLogL] 

A 

where  E^  denotes  approximate  sample  size  computed  by  (3.4).  Note  that 
R  is  a  function  of  s,  a ,  3,  c,  and  <r  .  For  fixed  a,  P,  and  a"  =  1,  the 
plot  of  R  versus  c  under  different  values  of  signal  strength  is  shown  in 
Fig.  3.  Also  for  c  *  2  and  o^=*l,  the  plot  of  TANH  "Q?^L  versus  logL  is 
shown  in  Fig.  4. 

The  results  show,  as  it  might  be  expected,  that,  according  to  the 
approximation,  the  nonlinearity  TANH(LogL/2)  requires  fewer  samples  chan 
LogL  requires,  and  this  difference  becomes  significant  as  c  and  signal 
strength  increases.  We  may  infer  that  under  small  signals,  the  nonlinearity 
TANH(logL/2)  performs  approximately  as  well  as  logL  does.  From  Fig.  4,  we 
can  see  that  for  the  regions  between  -5  and  5,  LogL  and  TANK (LogL/ 2)  are 
essentially  the  same. 

(b)  Generalized  Cauchy  Noise 


fc(*) 


-  1/c  1 

=  [cT:(cr,c)/2r(l/c)l[v  '  i(v  +  ±)/T(v) 

-(v  +  -) 

*[1  +  n(c,c)|x|]CM  c 


(3.16) 


Gaussian  Noise 


lation  ratio)  for  Gaussian  noise 


where  c  and  v  are  positive  parameters.  Note  that  for  c  »  2  and  v  *  k 
we  have  the  Cauchy  density.  We  also  know  that  as  the  parameter  v  in  the 
distribution  of  (3.16)  approaches  infinity,  the  resulting  distribution 
approaches  the  generalized  Gaussian  distribution  of  (3.12).  However 
unlike  the  generalized  Gaussian  density  which  always  has  a  variance,  the 
variance  of  the  generalized  Cauchy  density  will  be  finite  only  if  cv  >  2 
and  for  all  our  computations  v  =  ^  is  assumed.  For  c  =  2,  the  nonlinearities 
are  plotted  in  Fig.  10  and  Fig.  6.  The  plot  of  the  approximate  sample  ratio 
versus  c  is  shown  in  Fig.  5,  again  the  ratio  decreases  as  c  and  signal 
increases,  and  surprisingly,  for  the  case  c=4  and  signal  =1,  the  ratio 
still  has  0.994. 

(c)  Hyperbolic  Secant  Noise 

fg(x)  3  [  (exp{jTx/2c}  +  exp{-rrx/2a})  ]  ^ 

3  Sech(;rx/2CT)/(2a)  .  (3.17) 


Similar  graphs  are  plotted  in  Fig.  11,  Fig.  7  and  Fig.  8.  From  that,  we 
may  conclude  that  the  sample  ratio  always  decreases  as  signal  increases. 

In  Table  I  and  Table  II,  are  given  the  sample  sizes  under  different  signal 
and  error  probabilities.  We  can  see  for  the  same  condition,  our  approximation 
implies  that  Cauchy  noise  requires  more  samples  than  Gaussian  noise  or 
hyperbolic  secant  noises  require,  mainly  because  the  variance  is  not 
limited  under  Cauchy  noise. 


Hyperbolic  Secant  noi 


rsus  signals  under  Sech  noise 


L+l  . 
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TABLE  I 

Expected  sample  size  for  following  noise  densities  under  TANH(  --°|L  )  and 

2 

LogL.  P  *  0.95,  signal  *  0.4  and  a  ■  1. 


a 

Sech 

Noise 

LogL 

TANH(^^) 

LogL 

TANHC^2^) 

LogL 

TANH(^|^) 

1  x  10*1 

6.23 

6.16 

12.95 

12.94 

4.89 

4.88 

1  x  10"2 

13.05 

12.89 

27.12 

27.11 

10.25 

10.24 

1  x  10“3 

19.89 

19.65 

41.31 

41.30 

15.62 

15.60 

1  x  10-4 

26.72 

26.41 

55.51 

55.50 

20.98 

20.96 

1  x  10"5 

33.56 

33.16 

69.71 

69.70 

26.35 

26.32 

1  x  10“6 

40.39 

39.92 

83.91 

83.90 

31.72 

31.69 

I 
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TABLE  II 


Expected  sample  size  for  following  noise  densities  under  TANH (— °^)  and 


LogL.  a  =  10  j3  =  0.95  and  *  1. 


.5 


CHAPTER  4 


NUMERICAL  RESULTS 

Consider  our  integral  equation  which  is  a  Fredhelm  integral  equation 
of  the  second  kind,  i.e. 

GD 

g(x)  -  J  K(x,y)g(y)dy  -  g(x) 

0 

where  g(x),  K(x,y)  and  g(»)  are  defined  in  Chapter  2  and  K(x,y)  is  the 
symmetric  kernel.  In  general,  if  the  kernel  can  be  written  in  terms  of 
some  orthogonal  functions  on  the  interval  then  the  closed  form 

solution  can  be  easily  obtained  by  the  method  of  Hilbert-Schmidt  (see 
Lovitt,  1950).  Conversely,  if  such  functions  cannot  be  found,  often 
a  numerical  procedure  is  used  to  solve  this  general  equation.  Consider 
the  following  numerical  method. 

4.1  General  Procedure 

A  given  operator  equation 

Pf  -  g  (4.1) 

can  be  solved  approximately  for  f  by  substituting 


f  **  f 


(4.2) 


where  f  is  a  suitable  approximating  function  depending  upon  n  parameters 


Of 


,o<-,...,a  ,  substituting  (4.2)  in  (4.1)  to  give 
1  ^  n 


5  =  g  -  Pf 

n  n 


(4.3) 


and  then  minimizing  the  residual  function  5^  in  some  sense.  Provided  that 
.  *  * 

this  minimum  5^  is  small  enough,  the  function  f  determined  by  the  optimal 
* 

values  a.,  of  the  parameter  in  (4.3)  usually  provides  a  satisfactory 
approximation  to  the  solution  of  (4.1). 


* 
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This  type  of  method  can  be  applied  to  nonlinear  operator  equations, 
but  most  of  our  experience  with  it  has  been  limited  to  the  case  of  linear 
operator  equations.  In  this  case  we  solve 


Lf  =  g 

where  L  is  a  linear  operator,  by  substituting 

n 

f  f  =  2  a  .0  , 

n  .  ,  j  i 
J-l 

in  (4.4)  and  minimizing 


5  * 

n 


S 


Then  we  determine 


Z  Of  (1 4  ) 

j-l  J  J 


n 


E  a 
j=l 


(4.4) 


(4.5) 


(4.6) 


HOI 


min  it  g  -  Z  Of  Jr  || 

cf.  ,af„  , . . .  ,a  j=l  ■*  J 

12  n  J 


(4.7) 


The  parameter  values  calculated  in  (4.7)  give  an  approximate  solution 


* 


f  =  E  a.0. 
n  j-l  J  J 


to  (4.4).  In  practice  we  do  not  solve  (4.7)  exactly,  but  instead  the 
simplex  method  of  linear  programming  is  used  (Liu,  1968). 


* 


I 


46 


Example: 

Consider  the  Fredholm  integral  equation  of  the  second  kind 
1  TT'/2  l 

f(x)  *  4  J  xyf (y)dy  *  sin  x  -  £  x,  0  <  x  £  j 


(4.8) 


for  which  the  exact  solution  is  £(x)  »  sin  x,  suppose  that  the 
approximating  function  is  chosen  to  be 


3  5 

f3(x)  -  a^x  +  a2x  +  XjX 


(4.9) 


3  5 

then  we  have  n*3,0^=«x,  02  =  x  an<*  $3  *  x  substituting  (4.9)  in 
(4.8)  yields 


c 


i 


where 


5,(x)  -  g(x)  -  £  a  Jr 

i-i  J  J 


00 


g(x)  *  sin  x  -  £  x 

x  r^72  2 


ti(x)  -  x  -  f  J*  y^y  -  xd  -  it  (I)3) 

0 

♦2(*)  -  x3  -  f  JQ  =  x(x2  -  io  (f)5) 

t300  ■  x5  -  f  f  y6<1y  =  x(x4  -  jg  (j)') 


(4.10) 


The  next  step  is  to  minimize  the  residual  §3(x)  in  (4.10).  In  practice 
we  replace  (4.10)  by  a  discrete  problem 


max  |g(x.)  -  £  or  Jr  (x.) 

<*i  >a0,or.,  1  ^  i  <  m  j  =  l  J  J 


min 

1 2 5^3 


(4.11) 


We  often  choose  m  10  n,  for  this  example  the  value  of  or  obtain  by 
solving  (4.11)  with  m  =  33  points,  gives  the  approximate  equation 
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H 


f*(x)  =  0.99970x  -  0.16567x3  +  0.0075 lx5 


which  is  very  close  to  sin  x. 

4.2  Example  -  Gaussian  Noise 

Consider  the  following  zero-mean,  unit-variance  Bivariate  Gaussian 
Noise  density  which  in  terms  of  Hermite  polynomials 

“  P^He  (x)He  (y) 


fN  n  +i'x,y)  *  f(x)f(y)  z 
l,Nj  V“0 


"UT 


(4.12) 


where  is  the  coefficient  of  correlation  and  f  denotes  the  standard 
Gaussian  density.  Here  He^  (•)  is  the  Hermite  polynomial  of  order v  (note  that, 


H 


x 


=  Hev(x)).  Substituting  Eq.  (4.12)  in  Eq.  (2.50),  after  some 


V\V2 

arrangements  we  obtain. 


where 


33  oo 

Y  L(x)+1  “  mT(x)  J  S  2  P^Jv(x)J  (y)g(y)dy  *  g(x) 
-«  v*0  j  J 


11 

T(x)  = 

'  J 

n  j 

TT  SXP  i 

r  xW) 

s  •  cos  h(xs) 

• 

1 

L  J 

* 

1  -1 


J^(x)  *  [f (x-s)He^ (x-s)  -  f (x-l-s )He^ (x+s ) ] 


(4.13) 

(4.14) 

(4.15) 


and  Y  is  an  arbitrary  nonzero  constant.  It  can  be  easily  shown  that 
J  (•)  Is  not  an  orthogonal  polynomial,  therefore  we  apply  the  numerical 
method  in  Section  (4.1)  to  obtain  an  approximate  solution  to  Eq.  (4.13). 
This  is  plotted  in  Fig.  12  for  various  values  of  m  which  is  a  parameter 
indicating  the  level  of  dependency.  I t  is  also  interesting  to  know  that 
the  sample  size  required  under  these  nonlinearities,  and  this  is  shown 
in  Table  III. 


» 


From  Che  results,  we  may  say  that  the  sample  size  required  in  the 
m-dependent  case  is  less  than  that  needed  in  the  independent  case,  and 
that  the  required  sample  size  decreases  as  m- increases .  In  other  words, 
we  might  save  some  samples  by  increasing  the  sampling  rate. 
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CHAPTER  5 
CONCLUSIONS 

This  thesis  has  considered  several  aspects  of  sequential  detection 
systems.  It  has  been  shown  that  the  sample  size  needed  for  the  case  of 
m-dependent  process  is  less  than  the  case  of  independent  process 
required.  A  comparison  between  LogL  and  TANH(LogL/2)  is  also  examined 
for  the  asymptotic  case,  and  it  has  shown  that  TANH(LogL/2)  indeed  is 
the  optimum  nonlinearity  under  our  criterion.  Finally,  for  the  Gaussian 
noise  density,  we  compute  the  sample  size  and  plotted  the  nonlinearities 
under  different  signals  and  level  of  dependencies  (m) .  For  further 
investigation  one  might  study  the  ARE  between  m-dependent  sequential 
detector  and  m-dependent  fixed  sample  detector. 
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APPENDIX 


2  2 

To  show  J  (e)  =  J  (0)  +  ej'(0)  +  Xe  cr.CSg) 
g  g  g  l 

From  Eq.  (2.37)  we  have 
J  (e)  -  H(g  +  e6g) 

5 

=  J(g  +  e5g)f1  +  Xa2(e6g  +  g) 

-  Jgfx  +  Xa2(g)  -  Xa2(g)  +  J’e6g£1  +  Xo2(e6g  +  g) 

=  Jg(0)  -  Xff^(g)  +  +  Xcr2(e6g  +  g) 

-  J  (0)  +  eJ'(O)  -  c\[2j‘g6gf  +  2  Z  JJ*  2 

S  6  j=l 

•  gfigf^  ^  -  2(2mfl)(j*gf1)(j6gf1)]  -  Xa2(g)  +  Xa2(e6g  +  g) 

-  J  (0)  +  cj'(0)  +  e2X^(5g)2f  +  2  Z  JJ(6g)2f 

S  S  j=l  1’  j+1 


-  (2nH-l)(Jgf1)2} 

-  j  (0)  +  «J'(0)  +  e2Xo2( 6g) 

O  O  *• 


where  f  is  the  joint  density  of  and  N .+^  and 

function  under  H^. 


is  the  density 
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